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1. Introduction 





Abstract In the theory of belief functions, the measure of uncertainty is an important concept, 
which is used for representing some types of uncertainty incorporated in bodies of evidence such 
as the discord and the non-specificity. For the non-specificity part, some traditional measures use 
for reference the Hartley measure in classical set theory; other traditional measures use the simple 
and heuristic function for joint use of mass assignments and the cardinality of focal elements. In this 
paper, a new non-specificity measure is proposed using lengths of belief intervals, which represent 
the degree of imprecision. Therefore, it has more intuitive physical meaning. It can be proved that 
our new measure can be rewritten in a general form for the non-specificity. Our new measure is also 
proved to be a strict non-specificity measure with some desired properties. Numerical examples, 
simulations, the related analyses and proofs are provided to show the characteristics and good 
properties of the new non-specificity definition. An example of an application of the new non- 
specificity measure is also presented. 

© 2016 Chinese Society of Aeronautics and Astronautics. Production and hosting by Elsevier Ltd. This is 
an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-ne-nd/4.0/). 


fusing different evidences by using the commutative and 
associative Dempster’s rule of combination. The theory of 


The theory of belief functions’ is an important tool for belief functions has been widely used in the fields of informa- 


uncertainty modeling and reasoning. It can distinguish the a Per 
‘unknown’ and the ‘imprecision’ and provides a method for decision making,” 
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tion fusion,” pattern classification, ° and multiple attribute 


7 etc. Some modified or extended frame- 
works including the transferable belief model (TBM)? and 
Dezert-Smarandache theory (DSmT)’ were also proposed by 
researchers in the past decades. 


. PA . . . 
The measure of uncertainty'° |” is very crucial in all kinds 
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of theories of uncertainty. The concept of uncertainty is intri- 
cately connected to the concept of information. Therefore, to 
describe the uncertainty, measures in information theory are 
often used for reference. E.g., in probability theory, the 
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Shannon entropy”? is developed. In fuzzy set theory’* and its 
related applications,'*'® some entropy-alike measures also 
are proposed to represent the uncertainty.'’ Also, in the theory 
of belief functions, many entropy-alike measures are proposed 
such as the ambiguity measure (AM),!° the aggregated uncer- 
tainty(AU) measure'® to measure the total uncertainty in a 
basic belief assignment (BBA). Actually, in a BBA, there are 
two types of uncertainty.'° One is the discord (or randomness 
or conflict). Another is the non-specificity. They can be unified 
under the term ambiguity. 

For the discord part, many Shannon _ entropy-alike 
measures were introduced by researchers.'? Non- 
specificity'°'®° °? means two or more alternatives are left 
unspecified, which represents a degree of imprecision. It only 
focuses on those focal elements with cardinality larger than 
1. Non-specificity is a distinctive uncertainty type in the theory 
of belief functions when compared with the probability theory. 
Therefore, in this paper, we focus on the non-specificity part. 
There are also some non-specificity measures proposed.*!:7*-74 
The most typical one” is a generalization of the Hartley 
measure,” which is originally for the classical set theory. In 
probability theory, there is only discord (or randomness or 
conflict).'° Other available non-specificity measures?" use 
the simple and heuristic function for joint use of mass assign- 
ments and the cardinality of focal elements. 

In this paper, we aim to design a new non-specificity mea- 
sure without using the measure of classical set theory or using 
heuristic joint use of mass assignments and the cardinality of 
the focal elements, but to design using intuitive physical expla- 
nations of the uncertainty in the theory of belief functions. As 
aforementioned, the non-specificity actually represents a kind 
of imprecision. In the theory of belief functions, the precision 
is often modeled by lengths of the belief intervals. The mean of 
the belief intervals’ lengths for all singletons is defined as the 
non-specificity. Therefore, our new definition can be consid- 
ered as an averaging imprecision of different singletons. Fur- 
thermore, the new measure can be rewritten to a general 
form of non-specificity measure and it has several desired 
properties for uncertainty measures. 

The rest of this paper is organized as follows. In Section 2, 
the essentials of the theory of belief functions are introduced. 
Some available uncertainty measures, especially the non- 
specificity measures in the theory of belief functions are briefly 
introduced in Section 3. In Section 4, a novel non-specificity 
measure is proposed. Some desired properties are provided 
together with related proofs. In Section 5, we use some numer- 
ical examples and simulations to show the rationality of the 
proposed new non-specificity measure, where the comparisons 
between the available measures and the new one are provided. 
Also, an example of the application of the new non-specificity 
measure is given in Section 6. Section 7 concludes this paper. 


2. Basics of the theory of belief functions 


In the theory of belief functions, also called Dempster-Shafer 
evidence theory (DST)', the basic concept is the frame of 
discernment (FOD), which is a discrete and finite set. The 
elements in FOD are mutually exclusive and exhaustive. Given 
an FOD @, on its power set 2°, a BBA m:2° > [0, 1] can be 
defined satisfying 
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X m(A) =1, and m(@)=0 (1) 
A BBA is also called a mass function. All the A with m(A) > 0 
are called focal elements of a BBA m(-). The set of all the focal 
elements denoted by F and their corresponding mass assign- 
ments m constitute a body of evidence (BOE): (F, m). Based 
on the definition of BBA in Eq. (1), the belief function (Bel) 
and the plausibility function (Pl) are defined for any A C O 


as follows!: 
Bel(A)= X` m(B) 
BCO,BCA 
er, 2 
PI(A) = m(B) (2) 
BCO,BNAAD 


The belief function and plausibility function can be interpreted 
as a lower and a upper bound of the probability P(A), respec- 
tively, i.e., P(A) € [Bel(A), PI(A)], which is a belief interval of 
the focal element A. The length of the belief interval Len(A) 
= PI(A) — Bel(A) represents the degree of imprecision for A.! 

The mass assignment for the total set ©, i.e., m(@) repre- 
sents the degree of ignorance (or unknown) for a given BBA 
m. Therefore, the theory of belief functions can discriminate 
the “imprecision” and the “ignorance”. 

In the theory of belief functions, independent BBAs (mı, 
m) are combined using Dempster’s rule of combination as 
follows’: 


0 A= 


5 mı (Ai)m(B;) (3) 


AiNB;=A 
TK AAD 


where A; and B; denote the focal element of m, and mp, respec- 
tively. K denotes the conflict coefficient between mı and mp. 
Note that the BBAs to be combined using Dempster’s rule 
should be independent. The research related to the dependent 
BBAs can found in Ref.” Dempster’s rule of combination is 
both associative and commutative. There exist many other 
alternative combination rules, see details in Refs.’ 

DST has been argued for its drawbacks in past 
decades.” °! Some modified or improved frameworks were 
also proposed including the TBM® and DSmT.’ 


m(A) = 





3. Uncertainty measures in the theory of belief functions 


There are various kinds of uncertainty,'° e.g., the fuzziness, 
randomness (or discord or conflict), non-specificity, which 
can be represented and processed by different types of uncer- 
tainty theories.'°!' In the theory of belief functions, a BBA 
has two types of uncertainty, i.e., the discord and the non- 
specificity, hence ambiguity.'° Many uncertainty measures 
were proposed for the discord, the non-specificity, and the 
total uncertainty (including both two parts). 


3.1. Measures for discord in the theory of belief functions 


Measures for discord is to depict the randomness (or discord 
or conflict) in a BOE. Available measures for discord in the 
theory of belief functions are listed below. Although with dif- 
ferent names, they are all for the discord part of the uncer- 
tainty in the theory of belief functions. 
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(1) Confusion measure (1982) 
The confusion measure is proposed by Hohle*” as 
Conf(m =- m(A) )log,(Bel(A)) (4) 
ACO 
(2) Dissonance measure (1983) 

The dissonance measure is proposed by Yager”! as 
=- m(A )log,(PI(A)) (5) 
ACO 
(3) Discord measure (1990) 


The discord measure Disc is proposed by Klir and 
Ramer” as 


Disso(m) 


Disc(m) 


=- om m(A)log | 1 


ACO 


-5 mB 


E = 
BCO 


(6) 








(4) Strife measure (1992) 
The strife measure Strif is proposed by Klir and Parviz** 


225 _m(B) |A— ma 


Mog, |1 
ACO BOO 
(7) 





Strif(m) 


As we can see, they are all Shannon entropy-alike measure. 
The differences and relationships between the measures above 
can be found in Refs.'?** 


3.2. Measures for non-specificity in the theory of belief functions 


-e +4 20,21,23,35 . 
Non-specificity means two or more alternatives are 


left unspecified. It represents a degree of imprecision and only 
focus on those focal elements with cardinality larger than one. 
Non-specificity is a distinctive uncertainty type in the belief 
functions framework when compared with the probabilistic 
framework. So, the non-specificity is mainly concerned here. 
The available non-specificity measures are as follows. 


(1) Dubois & Prade’s non-specificity”? 
Š. m(A)log,|4| (8) 


ACO 


NS™ (m) = 


It is a generalized Hartley measure” from the classical 
set theory to the belief functions framework. When the 
BBA m(-) is a Bayesian BBA, i.e., it only has singleton 
focal elements, it reaches the minimum value 0. When 
BBA m(-) is a vacuous BBA, i.e., m(O) = 1, it reaches 
the maximum value log,(/O|). In fact, due to 
logo! = 0, the mass assignments of singletons are nui- 
sances in the computation of NS??. This definition 
was proved to have the uniqueness by Ramer”, that 
is, it satisfies all the expected requirements of the non- 
specificity measure.” 
(2) Yager’s specificity”! 





(9) 


ACO 


The maximum value is 1 (when the BBA is Bayesian); 
the minimum value is 1/|@| (when the BBA is vacuous). 
One can use 1 — S*(m) to denote the non-specificity. 


Actually, here the mass assignments of singletons are 
involved in the computation. 
(3) Korner’s non-specificity~* 
NS*(m) = X m(A) -|A| (10) 


ACO 


The maximum value is |O| (vacuous BBA); the mini- 
mum value is 1 (Bayesian BBA). Actually, here the mass 
assignments of singletons are involved in the 
computation. 

(4) In Korner’s work, a general form of the non-specificity 
(or specificity) measure is proposed as 


= X m(A) JAI) (11) 


ACO 


NS“ (m) 


As referred in Ref.”*, if a measure satisfies Eq. (11), it is a 
non-specificity measure (function). 


3.3. Measures for total uncertainty in the theory of belief 


functions 


(1) AU" 


AU(m) = max(—S°pc@P—logrp,) $-t 
€ [0,1], VOEeoe 


nd =1 (12) 


oeo 


Bel(4) < Xpo < 


OEA 


<1-Bel(A), VACO 


It is also called the “upper entropy”. AU is an aggre- 
gated total uncertainty (ATU) measure, which can cap- 
ture both non-specificity and discord. AU satisfies all the 
requirements for uncertainty measure including proba- 
bility consistency, set consistency, value range, sub- 
additivity and additivity for the joint BBA in Cartesian 
space.* 
(2) AM 


AM(m) = —5 “BetP,,,(0)log, (BetP,,(0)) (13) 


060 
where BetP,,,(@) = Svycgc@m(B)/|B|, VA C @ is the pig- 
nistic probability’ of a BBA. AM does not satisfy the 
sub-additivity which has been pointed out by Klir and 
Lewis. Moreover in the work of Abelan and 
Masegosa*’, AM has been proved to be logically non- 
monotonic under some circumstances. 


Note that non-specificity can also be defined in the frame- 
work of fuzzy sets?” or intuitionistic fuzzy sets.°* Here what 
we are concerned is the non-specificity in the theory of belief 
functions. 


4. Novel non-specificity measure based on the length of the belief 
intervals 


As we can see in the previous section, traditional non- 
specificity measures are either the generalization of the Hartley 
measure in classical set theory, or the one heuristically built 
from the joint use of the cardinality and the mass assignment 
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of the BBA. We do not prefer such expedient ways and aim to 
design a new non-specificity measure directly using the intu- 
itive concept of uncertainty in the framework of belief func- 
tions. The new measure is introduced below. 


4.1. Definition of new non-specificity measure in the theory of 
belief functions 


Non-specificity is in fact a kind of imprecision for different 
propositions in FOD. In the framework of belief functions, 
the degree of imprecision for each proposition A is represented 
by the length of the corresponding focal element’s belief inter- 
val [Bel(A), PI(A)]. Given an FOD © = {61,62,...,0,}, the 
belief interval for each singleton {0;}, i.e., [Bel({0;}), P1({@;})] 
can be obtained together with n belief intervals’ lengths Len 
(i) = Pl({6;}) — Bel({6;}). We define the mean of all the n belief 
intervals’ lengths as the new non-specificity as follows. 


NS" (m) = ESOPO} — Bel({0,})) (14) 
i=l 
Here, BI denotes the belief interval. NS®(m) represents the 
averaging imprecision in m, i.e., the non-specificity. To avoid 
the redundant use of the imprecision for each singleton, here 
we only use the belief intervals of singletons. 
Since 


Bel(6;) = m({0:}) 
P1(0;) = m({O:}) + X m({O:, 0Y) 


tg (15) 
+37) {;, 9;, O}) -+m(0) 
j=l k=l 
i<j j<k 


then, Vi = 1, 2,..., A, 


P1({0;}) — Bel({0;}) = Smt {6,,6)}) + SS om {0;, 0;, 9}) 


j=l k=l 
i<j j<k 


+---+m(@0) (16) 
Therefore, the non-specificity definition in Eq. (14) can be 
rewritten as 


NS” (m) =} >(PI({0,}) ~Bel({0,})) 


i=l 


=) 2 {0;,0;}) DDI ({0i, 0j 0x}) ++ mO) 


j=l k=l 
i<j j<k 


=- 1S m {6;,0;}) +35 vil {6;,6;, 0. }) +++: +n-m(@) 
ij=l m=] 
i<j i<j<k 


=> | 25 m(A) + 35 m(A 


ACO ACO 
|4[=2 |A[=3 


=) m(A) (17) 


ACO 
|A|>1 


)+---+n-m(0) 


So, it is actually the weighted summation of the normalized 
cardinality size of the focal elements except for singletons, 
where the weights are their mass assignments. That is to say 
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in computation of our belief interval-based non-specificity, 
there is no need to calculate the belief intervals but to just fol- 
low the final step in Eq. (17) with simple multiplication and 
summation operations. Eq. (17) can be further rewritten as 


NS”! (m) = Ema) -a - qal- 1)) (18) 


ACO 


where ô(-) is the Dirac delta function defined as 


1 x=0 
6(x) = 19 
0) {0 x40 a) 
Eq. (18) satisfies the general form in Eq. (11) if 
i A 
nap = a- aa- 0) (20) 


So, the definition in Eq. (14) is a non-specificity measure. 
According to Eqs. (14) and (18), obviously, NS®"(m) reaches 
its minimum value 0, when m is a Bayesian BBA; NS?) 
reaches its maximum value 1, when m is a vacuous BBA. It 
should be noted that our new measure expressed by Eq. (17) 
has two differences with that in NSŚ, although the Eqs. (10) 
and (17) have closely similar expressions. The first difference 
is that in our new definition in Eq. (17), singletons are not 
involved in computation. Actually, the mass assignments are 
canceled in the calculation of the singletons’ belief intervals’ 
lengths. However, in NS“, mass assignments of singletons 
are used. The second difference is that, our definition has a 
normalization factor n while NS* has no such a factor. 

Note that NS®(m) has many desired properties for an 
uncertainty measure as analyzed in the next subsection. 


4.2. Desired properties of new non-specificity measure 


(1) Range 
As aforementioned, NS®!(m) reaches its minimum value 
0, when m is a Bayesian BBA; NS®(m) reaches its max- 
imum value 1, when m is a vacuous BBA. This means 
that a Bayesian BBA corresponds to a maximally precise 
statement, while a BBA expressing total ignorance rep- 
resents the most non-specific (or the most imprecise) 
statement on the FOD.” 

(2) Monotonicity 
For (Fi,m)C (F2,m2), i.e., VA E€ P(O) : Bel, (A) > 
Bel (4), Pl(4) < P(A) or YA € P(O) : [Bel,(A), 
Pl, (A)] C [Bel (4), PL(4)], if a non-specificity measure 
NS satisfies NS(m,) < NS(m), then the property of 
Monotonicity”” holds. This means that a non- 
specificity measure in the belief functions theory must 
not decrease the total quantity of uncertainty in situa- 
tions where there is a clear decrease in information 
(increment of uncertainty). 


Our new non-specificity measure in Eq. (14) satisfies the 
monotonicity. See the proof below. 


Proof. If VA € P(O) : Bel; (A) 
then there exists 


> Bel2(A), Pl, (A) < PI,(A), 


YO; € © : Ply ({6,}) 


Therefore, 


< Pla({0;}), Bel: ({0,}) > Bel2({0,}). 
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Len, (i) = Pl ({6;}) — 


= Plh ({0;}) — 
<5 dbo 


End of Proof 


Bel, ({6;}) 
Bel,( ({0;}) > 


< a i) 
p Leni (0 


) > NS”! (m) < NS”! (m) 














(3) SymmetryIf two BBAs mı, m assign the same summa- 
tion of mass assignment values to focal elements with 
the same cardinality, then the non-specificity values of 
the two BBAs are equal. This is called symmetry.” 


Our new non-specificity measure in Eq. (14) satisfies the 
symmetry. See the proof below. 


Proof. According to Eq.(17), NS®'(m) = 
Bel({0;})) =; = 1/2 scat) y+ 35 > scom(A) 


|4|=3 
If Dea (A) = S acoja) Va=2,3,...,n, 
obviously, NS®"(m,) = NS?\(mz). 


PIAJ- 
ae: 











End of Proof 





(4) Multiplicativity for joint BBAA joint BBA!’ 
m:P(Ox x Oy) — [0,1] is a BBA defined on the Carte- 
sian product of two sets (two distinct FODs) Oy with 
cardinality ng, and Oy with cardinality ng,, where 
P(O@x x Oy) is the power set of Oy x Oy. Suppose that 
F is a set of focal elements of the joint BBA on the joint 
FOD Oy x Oy, and SEF. 


The projections of S on to Oy is denoted by S = {x € Oy] 
(x, y) e S, Vx € Oy}. The projections of S on to Oy is denoted 
by S, = {ye Oyl(x, y)eS, Vye Oy}. Then, the marginal 
BBAs can be defined as'” 


Meo,(A) = 5 m(R) VAC Oy 
S|Sp=A 


5 m(R) 
s|S,=4 


(21) 


Me,(A) = VAC Oy 


If m(-) = me, X Me, is a joint BBA on Oy x Oy, and two 
independent marginal BBAs are me,(-) and mo,(-) then 


NS(m) = NS(me,) : NS(mo,) (22) 


This is called the property of multiplicativity. 
Our new non-specificity measure in Eq. (14) satisfies the 
multiplicativity.°° See the proof below. 


Proof. 


AxB 
NS”! (m) =) (A x ae 


Noy ‘Noy 
|A| - |B| 
= 2 perl) )me y( B 
X Y 


= Vme, (4) 4 —. |. Smo, (B) W; 


x Noy 
= NS®(mo,) - NS”! (mo, ) (23) 





End of Proof 











(5) Sub-multiplicativity for joint BBAIf m(-) = mo, X me, is 
a joint BBA on Oy x Oy, and its marginal BBAs mo, (-) 
and me,(-), which are unknown to be independent or 
not, then, NS(m) < NS(me,) - NS(me,). This is called 
the property of sub-multiplicativity. The“ = ” holds only 
when mo, (-) and mo, (-) are independent. 


Note that the physical meaning of sub-multiplicativity is in 
essential the conservation of information, i.e., the amount of 
uncertainty in a joint BBA is no greater than the total amount 
of uncertainty of its corresponding marginal BBAs. The equa- 
tion holds if and only if the corresponding marginal BBAs are 
independent, i.e., there is not correlated part. If two marginal 
BBAs are dependent, then the double counting uncertainty 
amount should be removed, therefore, the total amount of 
uncertainty in the joint BBA is larger than the total amount 
in marginal BBAs. 


Proof. Suppose that S is the focal element in Cartesian space 
Ox x Oy; proj(S; Ox) = S, and proj (S; Oy) = S, represent 
the projections of S on Oy and Oy, respectively. 


The non-specificity NS?! of two marginal BBA mo,(-) and 
me,(-) are 


A A 
NS" (mo,) =>% Meo,(A 2 = =>% ( ` ms) AL 
ACOy Ox — Acey \ A=proj(S;Oy)=Sx Nox 
|A[>1 |A[>1 





B B 

i= viata ji | =y Y mS) |B| 
BCOy Oy  BCƏy \ B=proj(S;Oy)=Sy ae 
|Bj>1 Ja 


The multiplication of the NS”! for two marginal BBAs are 


NS! (mer) -NS"(me,) = >> (Sms j 
ACOy Ney 











|A|>1 
B 
` 5 X m(5) 181 
BCOy \ BES, Noy 
B|>1 
S. 
- Y mohl. D mohl 
SCOyxOy Noy sco;xOy Ney 
Sx|>1 \sy 1 
- g (Sel 15:1 
SCOyxOy Noy «Noy 
[Sx|[>L|Sp]>1 
S 
Ti See 
SCOyxOy Noy ` Noy 
|Sx|>1|Sy|>1 


= NS”! (mo, x mey) 





End of Proof 











It should be noted that Dubois & Prade’s non-specificity in 
Eq. (8) also satisfies all the properties including the monotonic- 
ity, the symmetry, the additivity (which is the counter-part of 
the multiplicativity here), and the sub-additivity (which is the 
counter-part of the sub-multiplicativity here). Here we pro- 
vide detailed explanations for the additivity and sub-additivity. 
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If m(-) is a joint BBA on @y x Oy, and the associated mar- 
ginal BBAs me,(-) and mg,(-) are independent, then 
NSP” (m) = NS??(mo,) + NS??(me,) because of log function 
involved in the definition of NS measure in Eq. (8). This is 
called the property of additivity. The additivity is in essential 
equivalent to the multiplicativity, i.e., they both describe the 
relationship between the non-specificity of a joint BBA and 
their corresponding independent marginal BBAs. 

If the marginal BBAs me,(-) and me,(-) are unknown 
to be independent or not, then NS??(m) < NS??(mo,)+ 
NS?’ (mo,). This is called the property of sub-additivity. 
The sub-additivity is in essential equivalent to the 
sub-multiplicativity. 

Therefore, both Dubois & Prade’s non-specificity in Eq. (8) 
and our new measure in Eq. (14) strictly satisfy all the require- 
ments (properties) of a non-specificity measure. Not all the 
requirements or properties can be satisfied for Yager’s defini- 
tion and Kornor’s definition. Our new definition in Eq. (14) 
and Dubois & Prade’s definition in Eq. (8) can both be used 
as a Strict non-specificity measure. Our new measure can be 
a good alternative of the traditional strict NSP?. We want to 
emphasize that the theoretic consistency is an very important 
issue when one defines some measure under a given theoretic 
framework. Our proposed measure keeps the consistency, 
thus, it is not the generalization of any measure in other frame- 
works. In the next section, some illustrative examples and 
simulations are provided to show the rationality of our new 
non-specificity measure. 


5. Illustrative examples and simulations 


5.1. Example 1 


Suppose that the FOD © = {6), 02, 03}. A BBA defined on 0 
is m(A) = 1, VA = O. At each step, m(@) has a decrease of 
A = 0.05 and each singleton mass m({0;}), i = 1, 2, 3 has an 
increase of 4/3. At the final step, m(@) becomes zero and m 
({0;}) = 1/3, i= 1, 2, 3. At each step, Dubois & Prade’s 
non-specificity (NS?"), Yager’s non-specificity (NS”), 
Kornor’s non-specificity (NS*), our proposed belief interval 
based non-specificity (NS®), total uncertainty measure AU 
and AM (they also include the non-specificity part according 
to their definitions) are calculated. The changes of these 
uncertainty values at different steps are illustrated in Fig. 1. 

As shown in Fig. 1, all non-specificity measures decrease 
with the increase of the mass assignments for singletons and 
the decrease of the mass assignment for ©. All the 
non-specificity measures compared here reach their minimum 
value when m becomes a Bayesian BBA, and they reach their 
maximum value when m is a vacuous BBA. They all provide 
rational behavior. Our proposed NS®'e€[0, 1] has natural 
normalization. Such a value range is more preferred as an 
uncertainty measure. Both of the minimum values of NS* 
and NSP” are 0. Therefore, by using normalization factor, they 
can have the value range of [0, 1]. However, the minimum 
value of NS* is 1 but not 0, which is not preferred. 

For the total uncertainty measure AU and AM, they never 
change in the whole procedure (at their maximum value). 
Although AU and AM declare that they can also depict the 
non-specificity part in the total uncertainty, they cannot dis- 
criminate the changes of BBAs at each step. This is because 
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Fig. 1 Change of different non-specificity measures and total 
uncertainty measures in Example 1. 


they are defined based on some probabilistic transformation 
from BBAs. In this example, for the probabilistic transforma- 
tion used in AM and AU, the results are always a uniformly 
distributed probability mass function (p.m.f.) P(0) = 1/3, 
i= 1, 2, 3, therefore AM and AU will never change here. 
According to our opinion, it is not judicious to define total 
uncertainty measure in the theory of belief functions by using 
for reference the uncertainty measure in probability frame- 
work, i.e., Shannon entropy. It should be better not to switch 
the framework but to directly design in the framework of belief 
functions. This is also our concerns and motivations for the 
design of belief interval based non-specificity measure. 


5.2. Example 2 


Suppose that the FOD © = {6), 02, 03}. A BBA defined on © 
is m(A) = 1, VA = ©. At each step, m(@) has a decrease of 
A = 0.05 and one singleton mass m({@\}) has an increase of 
A. In the final step, m(@) becomes zero and m({6;}) = 1. 
The changes of these uncertainty values (including NSP”, 
NS*, NS, NS®!, AU and AM) at different steps are illus- 
trated in Fig. 2. 


Uncertainty value 





Fig. 2 Change of different non-specificity measures and total 
uncertainty measures in Example 2. 
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At the first step, the BBA is a vacuous one, and at the last 
step, the BBA is a categorical one. So, each uncertainty mea- 
sure changes from their maximum value to the minimum 
value. In this example, AM and AU can also bring intuitive 
results because at each step the probabilistic transformation 
results are not always uniformly distributed p.m.f. 

Although in this simple case, all compared measures per- 
form well, it should be noted that some traditional measures 
will bring counter-intuitive behaviors as shown in the follow- 
ing examples. 


5.3. Example 3 


Suppose that the FOD is 0 = {6), 02, 03, 04}. A BBA defined 
on O is m(A) = 1, VA = {6), 02}. At each step, m(A) has a 
decrease of A = 0.05, and the other focal elements with 
cardinality of 2 (including {0), 63}, {0;, 04}, {@2, 03}, {02, 04}, 
{63, 04}) increase 4/5 = 0.01. At the final step, m(B) = 1/6, 
V|B| = 2. The changes of these uncertainty values (including 
NSPP, NSY, NSS, NSB! AU and AM) at different steps are 
illustrated in Fig. 3. 

Since in the whole procedure, all the focal elements’ cardi- 
nality is 2, all the non-specificity measures do not change. The 
total uncertainty AM and AU increase at each step and reach 
their maximum value finally. This is because that the proba- 
bilistic transformations of the BBAs gradually approach a uni- 
formly distributed p.m.f. with the change of the BBA at each 
step. 


5.4. Example 4 


Suppose that the FOD © = {6), 02}. A BBA defined on © is m 
({@1}) = a, m({02}) = b, m(@) = 1 — a — b, where a, be [0, 
0.5]. We calculate all the uncertainty values (including NSP”, 
NS*, NS, NS®!, AU and AM). The change of different 
uncertainty measures with the change of a and b is illustrated 
in Fig. 4. 

As shown in Fig. 4, the values of NSP? and NS”! are the 
same, because log>|A| = |A|/2, V|A| = 2. All non-specificity 
measures reach their maximum values when a = b = 0, i.e., 
m(@)=1, and reach their minimum values when 
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Fig. 3 Change of different non-specificity measures and total 
uncertainty measures in Example 3. 
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Fig. 4 Change of different non-specificity measures and total 
uncertainty measures in Example 4. 


a = b = 0.5, i.e., m(@) = 0. Since AU tries to find a p.m.f. 
with maximum Shannon entropy, and the uniformly dis- 
tributed P(01) = P(02) = 0.5 always satisfies the constraints 
above (because a, b € [0, 0.5]), no matter how a and b change, 
therefore, P(01) = P(02) = 0.5 is always picked up when cal- 
culating AU and thus, AU always equals log) 2 = 1. AM 
reaches its maximum value when a = b, because for a = b, 
the corresponding pignistic probability of the BBA is uni- 
formly distributed. 


5.5. Example 5 


This example is used for reference from.'° Given the size of the 
FOD |0|=5. Randomly generate 10 BBAs with k 
(I <k <31) focal elements according to algorithm”? in 
Table 1. Here, we set the number of focal elements to a fixed 
value 15. 

These generated 10 BBAs (mı, mp, ..., Mo) are then com- 
bined one by one using Dempster’s rule of combination, 
respectively. At each combination instant £ mP$ = 
M1PpsmPS, where t= 1, 2, ..., 9, and we start with 
mPS = m,. The values for NSP}, NSY, NSS, NS?!, AU and 
AM of the combination result at ¢ are calculated for 
mPS, t=1,2,...,10. The whole procedure is repeated 100 


Table 1 Algorithm: Random generation of BBA. 





Algorithm: Random generation of BBA 


Input: ©: Frame of discernment; 
Nmax: Maximum number of focal elements 
Output: m: a BBA 
Generate the power set of ©: P(O) 
Generate a random permutation of P(O) > R(@); 
Generate a integer between 1 and Nmax > K; 
FOR each First k elements of R(@) do 


Generate a value within [0,1] => mv(i),i= 1,2,...,k; 
END 
Normalize the vector my = [mv(1),mv(2),...,mv(k)] > mv’ 


m(Aj) = mv(/), j= 1,2,..5k 
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Fig. 5 Change of different non-specificity measures and total 
uncertainty measures in Example 5. 


times and the average values of different uncertainty measures 
at different instants are shown in Fig. 5. 

As shown in Fig. 5, all the uncertainty measures compared 
here decrease with the increase of the combination steps. This 
makes sense, because it is intuitive that the uncertainty 
decreases in the information fusion procedure like the evidence 
combination. The non-specificity measures drop faster and 
more significantly than the total uncertainty measures. This 
is because that in the evidence combination based on Demp- 
ster’s rule, the focal elements are split into focal elements with 
smaller cardinality. 

As we can see in the above examples, our new proposed 
belief interval-based non-specificity measure is rational and 
effective in representing the non-specificity in BBAs. 


6. Application of belief interval-based non-specificity measure 


Uncertainty measures including the non-specificity measure 
have be used in many applications such as the weighted evi- 
dence combination.*°*! Here we provide an example of using 
our new non-specificity in feature evaluation for pattern recog- 
nition to further show the rationality of the proposed measure. 

We artificially generate three classes of samples. Each class 
has 100 samples. Each sample has 3 dimensions. In each class, 
each dimension of the samples is Gaussian distributed with dif- 
ferent mean and standard deviation (Std) values as illustrated 
in Fig. 6 and Table 2. 


0.4 


Probability density function 
Probability density function 





0 
-5 


Sample 


(a) Feature 1 


— Class 1 
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Table 2 Gaussian distribution parameters of the samples. 








Features Class 1 Class 2 Class 3 
rs a a 
ee ee 
e ne es 


As we can see in Fig. 6 and Table 2, the class discrimination 
capability of Feature 2 is the best, because the three Gaussian 
probability density functions (PDFs) are quite well separated; 
that of Feature 3 is the worst, and that of the Feature 1 is in 
the middle. This can also be verified by using the discrimina- 
tion criterion as follows. 


_ tr(Sy) 
> tr(.S,) 





(24) 


where tr(-) denotes the trace of a matrix. Suppose that there are 
C classes and each class C; has N; samples. The degree of inner- 
class cohesion Sw and the degree of inter-class separability Sp 


are as follows. 2 
pe[(x-a y x) (x-4 y x) ] 
XEC; XEC; 


T 
S = src aaa u)(: Sox m) 
' EC; YEG: 


where X is feature(s) of a sample and 


M-35 (7 ie x) (26) 


is the mean of all the classes’ centroids. If J of some feature (or 
set of features) in Eq. (23) is smaller, then such a feature (or set 
of features) is more crisp and discriminable. 

For our artificially generated samples J(1) = 0.2557, J(2) 
= 0.1013, J(3) = 326.8135, which means that Feature 2 is 
the best, Feature 3 is the worst, and Feature 1 is in the middle. 

First, we use the following way* to generate BBAs for each 
sample xg on different feature ie {1, 2, 3}. 





(25) 
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Fig. 6 Probability density function of different features of the samples belonging to three classes. 
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Illustration of BBA generation. 
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m, (Aj) E (27) 
where dą; denotes the distance between the query sample x, and 
the class A;. Parameters « = 1, p = 2 as suggested in Ref.* It 
should be noted that in the original form in Ref.*’, there exists 
the mass assignment for the emptyset @ representing the possi- 
bility of xq to be an outlier. In this paper, we only concern the 
closed-world assumption, i.e., there is no mass assignment for 
@. Here we give an illustrative example in Fig. 7. 

In Fig. 7, three different colors represent three different 
classes. cı denotes the centroid of samples in Class 1; c12 
denotes the centroid of samples in Class 1 and Class 2; ¢123 
denotes the centroid of samples in Class 1, 2, and 3. Calculate 
the distance d between x, and those centroids of single classes 
and compound classes. Then according to Eq. (26), the BBA 
can be generated. 

Second, we calculate NS® for all the BBAs generated. Then 
calculate the average values of NS”! for different feature i as 


mean_NS" (i) = NS" (mi) (28) 


XqE {C1 ,C2,C3} 


The averaging non-specificity of a feature is larger, then it is 
more discriminable. 

For our artificially generated samples illustrated in Fig. 6 
and Table 2, 


mean NS”!(1) = 0.3447, mean_NS®!(2) 
= 0.3088, mean_NS®!(3) = 0.4285. 


This is consistent with the intuition and the feature evalua- 
tion based on the discrimination criterion in Eq. (23). 


7. Conclusions 


A novel strict non-specificity measure in the theory of belief 
functions is proposed with several desired properties. It should 
be noted that the new measure is defined directly in the frame- 
work of belief functions. There is no need to switch (and thus 
lose information) from belief functions to the classical proba- 
bilistic framework. Numerical examples, simulations, and the 
application of the new measure are also provided, which show 
that the new measure can well measure the non-specificity in a 
BBA and can be effectively used in applications such as feature 
evaluation. 


In future work, we attempt to apply our new measure in 
other applications such as the weighted evidence combination, 
etc. We will also research on the other part of uncertainty, i.e., 
the discord, and the total uncertainty directly in the framework 
of belief functions (not transforming to the probability frame- 
work). There are already some related tentative related works 
on this.**“° 
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